A RECEDING HORIZON STRATEGY FOR SYSTEMS 
WITH INTERVAL-WISE ENERGY CONSTRAINTS 

EDUARDO ARVELO AND NUNO C. MARTINS 

Abstract. We propose a receding horizon control strategy that readily handles 
systems that exhibit interval-wise total energy constraints on the input control 
sequence. The approach is based on a variable optimization horizon length and 
contractive final state constraint sets. The optimization horizon, which recedes 
by TV steps every N steps, is the key to accommodate the interval-wise total 
energy constraints. The varying optimization horizon along with the contractive 
constraints are used to achieve analytic asymptotic stability of the system under 
the proposed scheme. The strategy is demonstrated by simulation examples. 
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1. INTRODUCTION 



We are interested in designing a receding horizon control (RHC) algorithm that 
is able to readily accommodate interval-wise total energy constraints (ITEC). An 
ITEC system has the property that the total energy of the control input during 
a (pre-established) periodic time interval is limited (See Fig. [I]). Examples of 
systems subject to ITEC include solar-powered systems that operate on battery 
power when sunlight is not available (e.g., at night). One can think of solar 
houses and solar-panel equipped mobile agents performing surveillance tasks for 

>q an extended period of time. Other examples of systems subject to ITEC can also 

be found in avionics and include temperature control of the aircraft cabin, for 
which power allocation may be limited at certain times, such as during take-off 
and landing. 

The idea behind RHC is simple: the controller solves a finite-horizon control 
problem, and the first element of the computed control sequence is applied to the 
system. At the next time step (or sampling time for continuous-time systems), 
the procedure is repeated. The RHC strategy is very appealing because in most 

S^ cases it allows for online tractable computation of the control input that does not 

suffer from the deficiencies of a pure open-loop strategy. The main drawback is 
that the direct implementation of RHC can be disastrous because stability is not 
(immediately) guaranteed. 

Receding horizon control (or equivalently, model predictive control) dates back 
to the 1960s, but not until the late 1980s was the issue of stability dealt rigorously 
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[]]. Until then, industry proponents of RHC had to manually "fine tune" param- 
eters to achieve a seemingly stable system. The first modification of RHC that 
guaranteed stability was the introduction of a zero final state constraint |2J,[3J, 
which in many cases renders the finite optimization problem unfeasible (or at the 
very least, it places a heavy burden on the controller). Later relaxations of the 
zero final state constraint included terminal cost functions (that penalize large fi- 
nal states) and terminal invariant constraint sets [3], [5], [6]. For a detailed survey 
of RHC, see pQ. 

Any of the traditional implementations of RHC (with step wise receding horizon) 
cannot readily accommodate the ITEC, as we explain in the next section. To 
remedy this problem, we implement a strategy that utilizes an initial horizon 
length of 2N that recedes by iV steps every N steps (where N is the length for 
which the ITEC is active) and does not recede at any other time instances. The 
basic idea is for the optimization horizon to encompass the ITEC in its entirety 
at all times. To guarantee stability of the system under this strategy, we impose 
contractive final state constraints during the optimization intervals for which the 
ITEC is not imposed, along with the assumption that the system is /3-stabilizable 
(to be defined in section [3]). 

The idea of contractive constraints was first suggested by [7] and has been later 
used in other works, such as [8] and [9] . These papers also make use of a varying 
horizon strategy, which is also employed in [TU], where a dual-mode controller is 
employed that steers the system to an invariant set by a horizon length that is 
computed online, and once the state lies in the invariant set the controller changes 
mode to drive it to zero. In [9], two horizons are employed: a shorter horizon 
used in the computation of the control sequence, and a longer horizon in which 
the predicted final state (propagated with constant input over the longer horizon) 
needs to satisfy the contractive constraint. The paper that is most similar to this 
one is [8], where a smaller, non-receding contraction horizon is employed. However, 
the prediction horizon moves at every step and is not suitable for problems with 
systems subject to ITEC. Another paper worth to mention is [UJ, where a time- 
varying terminal constraint set is employed. Though the terminal constraint is not 
(necessarily) contractive and the authors employ a fixed horizon length, we feel 
this work is relevant to our research due to the time- varying nature of the terminal 
constraint set. 

The paper is organized as follows: in section [2j we give the problem statement 
and discuss the shortcomings of the traditional RHC strategy applied to systems 
subject to ITEC. In section |3j we introduce the idea of /3-stabilizability. In section 
|4| we describe the new RHC strategy, and provide proof of the stability of the 
system under the proposed algorithm. In section |5j we give a concrete example 
along with simulation results that showcases the new RHC strategy. In section |6j 
we conclude. Finally, in the appendix we provide the proof to a lemma used to 
prove our main result. 
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Figure 1. ITEC systems: Total energy constraints are enforced 
only at certain intervals 

2. Problem Statement 
Suppose we have a system with dynamics given by: 

(1) x(k + l) = (j)(x(k),u(k)), 

where x(k) e M. n and u(k) e M. m are the state and the input of the system at time 
k, respectively; and <fi : W 1 x M. m — > M. n , with 0(0, 0) = 0. Moreover, the system is 
constrained by: 

(2) u(k) G U, Vk 

(2p)N-l 

(3) Yl \Hk)\\ 2 <C, P eZ + , 

k=(2p-l)N 

where hi is the input constraint set. Constraint (J3J) is known as the interval- wise 
total energy constraint (ITEC). In a real world application, this would be imposed 
during time intervals in which the system needs to rely solely on battery power. 
During other time intervals the system is powered by other energy sources (such 
as solar panels) and the total energy constraint is not imposed (see Fig. [I]). 

The infinite horizon control problem is to find the control sequence that mini- 
mizes the quadratic cost: 



(4) 



minimize \^ ||x(fc)|| 2 + ||u(A; — 1) 



fe=i 



subject to @,(|2) and Q. 



One way of generating control inputs in a tractable-online fashion is to em- 
ploy a RHC strategy. The traditional implementation of RHC, however, causes 
a dilemma: how much energy should the controller allocate to the interval that 
partially covers the total energy constraint interval? One approach is to propor- 
tionally allocate the energy constraints. For example, with a horizon iV = 3, the 
traditional receding horizon approach would perform a finite optimization at k = 1 
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Figure 2. Traditional RHC with N = 3. Note that during times 
k = 1 and k = 2, the total energy constraint interval is partially 
covered by the optimization horizon 



see Fig. [2| given by: 



minimize \ ^ ||a;(fc)|| 2 + \\u(k — 1) 



k=2 

subject to @,@ 

|K3)|| 2 <C/3, 

and at time k = 2, the total energy constraint would become: 

H3)|| 2 + |K4)|| 2 <2Cy3. 

In this paper we propose a modified receding horizon strategy that not only pro- 
vides analytical stability guarantees, but also does not require a heuristic solution 
to the ITEC allocation problem. It is important to note that the overlap of the 
constraint interval at the beginning of the optimization interval is no cause for 
concern. For example, at time k = 4 in Fig. [2] the amount of energy spent by w(3) 
cannot be changed, say ||m(3)|| 2 = 73. Then, the optimization will be carried out 
with the total energy constraint equal to: 

IK4)|| 2 + |K5)|| 2 <C- 7 3. 



3. /3-STABILIZABILITY 

The system is said to be /3-stabilizable with iV steps if there exists an admissible 
control sequence that reduces the size of the state by a factor of j3 in iV steps. In 
this paper, we do not require the contraction to occur over the optimization interval 
where the ITEC is active. A formal definition of /3-stabilizability with ITEC is 
given below: 
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Definition 1. We say that a system <ft is (5-stabilizable with ITEC parameter C 
and horizon N in an open ball B N centered around the origin if there exists o > 
such that: 

(5) U N (x,a^)^0 

(6) U^(x,a)^0 

where x G Bn, and Ujs[{x{k) : a, (3), with < (3 < 1, is the set of all finite control 
sequences of length N such that: 

k+N 

(7) £ iix^ir + IKj-i)!! 2 ^^!!^)!! 2 , 

j=k+i 

(8) u{k) G U 

(9) ||x(A; + iV)|| 2 </3||x(A;)|| 2 

and U^(x(k), a) is the set of all finite control sequences of length N such that py 
and M) hold and 



(10) ||x(A; + iV)|| 2 < ||x(A;)|| 2 

k+N-l 

(li) Y, IK*OII 2 <c, pez + , 

j=k 



Note that (10) does not impose contraction of the state norm if we constrain the 



control sequence to respect (11 ). We only require the state not to grow. Moreover, 



if the system has zero-input dynamics given by (j)(x(k) } 0) = x(k), then (10) is 
immediately satisfied. 

4. INTERVAL- WISE HORIZON CONTROL 

In this section, we present an interval-wise receding horizon strategy (IRHC) 
that uses varying optimization horizons and contractive constraints. The varying 
horizon will not only enable the construction of an appropriate strategy for the 
problem with ITEC, but also guarantee asymptotic infinite horizon stability of the 
system with the imposition contractive constraints and the assumption that the 
system is /3-stabilizable. 

In order to accommodate for the total energy constraint, we employ a receding 
horizon strategy that entirely encompasses the constraint interval at all times (see 
Fig. [3]). To accomplish this, the horizon is initially set for h = 2N. Traditional 
RHC is performed, except that the horizon does "recede" (i.e., h = h — 1). When 
the horizon reaches h — N + 1, it is expanded again to h = 2N. 

We implement a receding horizon strategy in the following way: 

Algorithm 1. IRHC with contractive constraints 



EDUARDO ARVELO AND NUNO C. MARTINS 



.*•*: = 4 



->k 



->fc=l 



*/fe = 3 



-»fc = 



12 



Figure 3. Interval- wise RHC with parameter N = 3 based on al- 
gorithm [I] 

(1) Set the optimization horizon h = 2N, time index k = 0, energy-used track- 
ing parameter 7 = and auxiliary indices i = 0, f = and p = N . 

(2) Read in x(k) and solve the constrained optimization problem: 

k+h 

minimize 2, II^C?')!! 2 + \\ U (J ~ l)l| 2 
j=k+i 
, 10 x subject to (§,(§ 

£ IKj)II 2 <c-7, 

j'=max{p,fc} 

lk(£: + /i c )|| 2 </3 (m) ||x(0)|| 2 

and appfo/ i/ie /irst element in the resulting control sequence to the system, 
say U\. 

(3) If f = (this means the ITEC sits at the beginning of the optimization 
horizon), set 7 = 7 + ||tti|| 2 

(4) Reduce horizon h = h — 1. 

(5) If h = N, set h = 2N (this will push the horizon N steps ahead) and 7 = 

. If k = p — 1, set % = i + 1 (this will contract the constraint at the end of 
the new horizon), f = 1; else ifk = p + N — l, set p = p + 2N and f = 0. 

(6) Set k = k + 1 and go back to step 2. 



We are now ready to state our main result: 

Theorem 1. // the ITEC system (f) is (5-stabilizable with horizon N , then the 
interval-wise receding horizon strategy described in Algorithm\^will drive it asymp- 
totically stable for any initial condition in x(0) G B^. Furthermore, the resulting 
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dynamics will satisfy: 

00 1 4- 8 

(13) £ IK?')I| 2 + HJ - 1)H 2 < Y^B a \ W°)ll 2 ' 
3=1 P 

We will prove this result by constructing a sequence of control sequences v q (k) 
indexed by q that converges to the control sequence obtained by Algorithm [I] and 
a bounded sequence T q , associated with v q (k). To proceed, we need to define v q (k) 
and T q : 

Definition 2. v q (k) is a q-indexed sequence of control sequences defined by: 

f ViW < A; < (g - l)iV; 

(14) v q (k) = I uX 2)N ^ (q-l)N<k<(q + l)N; 

{ k> (q+l)N 

where u* k 2 is the control segment obtained by Algorithmic for k\ < k < &2, o^c? 
Vi(fc) is given by: 

(15) < k) = { fe > 2iV 

In other words, u 9 (/e) is indexed with each time the horizon is pushed iV steps 
ahead, and it consists of the past control inputs and the current 2N control seg- 
ment, followed by zeros. 

Definition 3. T q is defined as: 

{q+l)N 00 

(16) r,= E \\*U)\\ 2 + \\v q U-i)\\ 2 + E r4l *ll*(o)ll a 

j=l j=q+l 



where v q is as in (14) and x(j) is generated by vJj — 1) and the dynamics (Til), 



and [■] is the ceiling function. 

Finally, the following lemma will be crucial to prove the asymptotic stability of 
the system under Algorithm [TJ 

Lemma 1. If the system is (3-stabilizable with horizon N, then: 

(17) r q <[±|a||x(0)|| 2 , Vg>l 

where T q is as in (iffy . 

Proof of Lemma [I[ See Appendix. □ 

Proof of Theorem [I[ Let G be defined as the infinite horizon cost incurred by the 
system under Algorithm [TJ i.e.: 
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(18) 



G = £lW* + l)ll a + ll«*(*)ll : 



fc=0 



and note that we can write: 



(19) 
(20) 



\u*(k)\\ 2 =\\u*(k)-v q (k)+v q (k)\\ 2 

<\\v q (k)\\ 2 + \\u*(k)-v q (k)\\ 2 ; 



and so, G is bounded by: 

oo 

(21) G < lim Y\\x{k + 1)|| 2 + |K(A;)|| 2 + \\u*(k) - v q {k)\\'< 



q— >oo 



fc=0 



G< limr g + lim V \\u*(k) - v g (k)\\' 



Using (16), the previous inequality can be written as: 

(22) 
(23) 
(24) 



q— >oo q— >oo 



fc=0 



< 



lim r„ 

q— >oo 

1 + /3 
1-/3 



cr||x(0)||' 



where (23) comes from the fact that the sequence v q (k) converges to sequence 
u*(k), and (24) comes from (17). This concludes the proof. □ 



Note that the IRHC algorithm can also be applied to system without ITEC, as 
described in the following corollary: 

Corollary 1. If the non-ITEC system <p is f3-stabilizable with horizon N , then the 
IRHC strategy described in Algorithm [7] (modified to add contraction at every N 
steps) will drive it asymptotically stable for any initial condition in x(0) G B^. 
Furthermore, the resulting dynamics will satisfy: 



(25) 



£lKi)ll 2 + IKi-i)ll 2 < 



a 



3=1 



1-/3 



\x 



The proof is similar to that of Theorem [T} 

It is important to mention that the bound on the infinite horizon cost is only 
used to prove stability of the system and no claims on tightness are made. 
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5. SIMULATION 

In this section, we employ the proposed algorithm to stabilize the two-dimensional 
nonlinear oscillator previously discussed in [12]. The dynamics of the system are 
given by: 



X\ =x 2 

x 2 = - 



/TV i._ 

X\ I — + tan (oxi 
hx\ 



2(1 + 25x?) 



+ 4x 2 + 3m 



We used Matlab to implement the proposed IRHC algorithm to the discretized 
version of the system with sampling period 0.05 and ITEC parameters C = 4.8, 
N = 4, initial state x(0) = [2; —1] and /3 = 0.8. The /3-stabilizability (with 
(3 = 0.8) was determined empirically. Figs. [4] and [5] show the evolution of the 
norms of the state and of the input, respectively, at different time instances. The 
solid lines (marked with x's) represent past signals while the dashed lines (marked 
with circles) represent the future prediction. Note that the ITEC constraints are 
satisfied and that the prediction horizon encompasses the constraint intervals in 
their entirety. Fig. [6] shows the plot of x% vs. x%. Though the trajectory of the 
states have a oscillatory nature, the algorithm stabilizes the system. 

Since this example was used in [12] to showcase the dangers of the direct appli- 
cation of a receding horizon strategy, we made further simulations where the ITEC 
is not imposed. An interesting characteristic of this system (and the reason it was 
discussed in [12]) is that the direct application of a RHC strategy works well for 
certain horizons, but is unstable for others. We ran simulations with N = 4 and 
N = 5 for the same initial condition as before. The traditional RHC used a fixed 
horizon of 2N and no endpoint constraints, while the proposed IRHC algorithm 
used contractive constraint parameter j3 = 0.8 and (3 = 0.2. We also compare the 
receding horizon strategies to the one obtained by u = —3x 2 (see [12J). As we can 
see from Figs. [7] and [8j the RHC performs very well for N = 4, but the system 
becomes unstable when the horizon is increased to N = 5. The proposed IRHC 
strategy with N = 4 displays a similar oscillatory behavior as before, but incurs 
a lower cost. Table [T] gives the simulated infinite horizon costs for all cases. Note 
that the system with the constraint /3 = 0.8 yields a lower cost than the system 
with the tighter constraint /3 = 0.2, but convergence is faster. Moreover, it is 
interesting to note that when the horizon parameter is increased to N = 5, the 
total cost for /3 = 0.8 increases while the cost for /3 = 0.2 decreases. 
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Figure 4. Evolution of the state norm for the ITEC simulation. 
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FIGURE 5. Evolution of the input norm for the ITEC simulation. 



6. CONCLUSION 

We proposed a modified receding horizon strategy that readily handles total 
energy constraints that are only imposed at certain pre-specified periodic time 
intervals. Our approach utilizes an interval-wise receding horizon for the online 
optimization problem and contractive constraints to guarantee boundedness of 
the infinite horizon cost. The new algorithm is demonstrated by an example 
and compared to the direct implementation of the traditional step-wise receding 
horizon when no constraints are imposed. Future work include the use of imperfect 
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Figure 6. ITEC simulation: x\ vs X2 



Table 1. Performance Comparison 





N = 4 


N = 5 


u = — 3x 2 


325.4 


RHC 


437.2 


Unstable 


IRHC(/3 = 0.8) 


412.9 


539.4 


IRHC(/3 = 0.2) 


3947 


2053 



state information (in a stochastic setting) and the application of this strategy to 
decentralized control problems. 



Proof of Lemma\l\ We will show that: 



(26) 



r,<^|a||x(0)|| 2 , Vg>l, 



by first showing that r g+1 < r„, for all q > 1. Let 



(27) 



r g = r; + rj + r3 + rj + r; 
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Figure 7. Non-ITEC simulation with parameter N — 4, IRHC 
with /3 = 0.8. Here the traditional RHC is stables and performs well 
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Figure 8. Non-ITEC simulation with parameter N — 5, tradi- 
tional RHC is unstable but IRHC /3 = 0.8 with still stabilizes the 
system 



where: 

(28) 

(29) 

(30) 

(31) 
(32) 



(q-l)N 

rj= e iwj)ir+iK(j-i)ir 

r 2 = £ IWj)II 2 + IK(j-i)II 2 

j=(g-l)JV+l 
(g+l)JV 

r?= E IWj)ir + IK(j-i)ll 2 

j=gAf+l 

-94-1 



rJ = ^ a M a || x (o)|| : 



r;= £/^vi 

j=q+2 



X 
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From the definition of v q (k), we have that: 

(33) rj +1 = rj + r^. 

We also note that 
(34) T 2 q+1 + Tl +1 < Tl + Tj 

from the definition of v q and the assumption that the system is /5-stabilizable. 



(35) 
(36) 



Moreover, from simple inspection of ( J3 1[ ) and (32), we have that 

oo 



F 4 + F 5 

1 q+l + L q+l 



'a\\x 



j=q+2 

4 



Finally, using ( 33 ) , ( 34 ) , ( 36 ) , we conclude that 
(37) 



(38) 
(39) 

(40) 

(41) 
(42) 






2JV 



£ii*Mi a +ii«tt-i)ii 2 +£/s ri vi 

3=1 3=2 



X 



< a\\x 



+ /3a||x(0)|| 2 + ^/^V||x(0)|p 



J=2 



{1 + 2/3 + 2 X>jcr| 

1 + 



1-/3 



cr||x(0)|| 



i=2 

2 



where (40) follows from the definition of /3-stabilizability. 



□ 
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